Method and system for caching a generated query plan for time series data

ABSTRACT

In a method for caching a generated query plan for time series data, a query plan for time series data is generated based on a query comprising an expression, the query plan including a path of execution for resolving the query. The path of execution of the query plan to resolve the query is executed. A result of the path of execution is returned as a response to the query. The query plan is cached for retrieval and execution responsive to receiving another query that matches the query, such that the query plan can be used to resolve the another query.

RELATED APPLICATION

This application claims priority to the provisional patent applicationhaving application Ser. No. 62/550,171, entitled “WAVEFRONT DP PLANNER,”with filing date Aug. 25, 2017, by Clement Pang, and assigned to theassignee of the present application, the disclosure of which is herebyincorporated herein by reference in its entirety.

BACKGROUND

Management, monitoring, and troubleshooting in dynamic environments,both cloud-based and on-premises products, is increasingly important asthe popularity of such products continues to grow. As the quantities oftime-sensitive data grow, conventional techniques are increasinglydeficient in the management of these applications. Conventionaltechniques, such as relational databases, have difficulty managing largequantities of data and have limited scalability. Moreover, as monitoringanalytics of these large quantities of data often have real-timerequirements, the deficiencies of reliance on relational databasesbecome more pronounced.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and form a part ofthis specification, illustrate various embodiments and, together withthe Description of Embodiments, serve to explain principles discussedbelow. The drawings referred to in this brief description of thedrawings should not be understood as being drawn to scale unlessspecifically noted.

FIG. 1 is a block diagram illustrating a system for managing dataincluding responding to a query regarding time series data, inaccordance with embodiments.

FIG. 2 is a block diagram illustrating a planner for generating a queryplan for responding to a query regarding time series data, in accordancewith embodiments.

FIG. 3A is a block diagram illustrating a stage executor for executingmultiple paths of execution during query plan generation, in accordancewith embodiments.

FIG. 3B is a block diagram illustrating stage execution for executingoperations for stages of one path of execution during query plangeneration, in accordance with embodiments.

FIG. 4 is a block diagram of an example computer system upon whichembodiments of the present invention can be implemented.

FIG. 5 depicts a flow diagram for generating a query plan for timeseries data, according to various embodiments.

FIGS. 6A through 6E depict flow diagrams of operations for generating aquery plan for time series data, according to various embodiments.

FIG. 7 depicts a flow diagram for generating indices for time seriesdata, according to various embodiments.

FIG. 8 depicts a flow diagram for dynamic refresh of an index duringquery path generation for time series data, according to variousembodiments.

FIG. 9 depicts a flow diagram for using a cached query plan for timeseries data, according to various embodiments.

FIG. 10 depicts a flow diagram for evaluating a cached query plan,according to various embodiments.

DETAILED DESCRIPTION OF CERTAIN EMBODIMENTS

Reference will now be made in detail to various embodiments of thesubject matter, examples of which are illustrated in the accompanyingdrawings. While various embodiments are discussed herein, it will beunderstood that they are not intended to limit to these embodiments. Onthe contrary, the presented embodiments are intended to coveralternatives, modifications and equivalents, which may be includedwithin the spirit and scope the various embodiments as defined by theappended claims. Furthermore, in this Description of Embodiments,numerous specific details are set forth in order to provide a thoroughunderstanding of embodiments of the present subject matter. However,embodiments may be practiced without these specific details. In otherinstances, well known methods, procedures, components, and circuits havenot been described in detail as not to unnecessarily obscure aspects ofthe described embodiments.

Some portions of the detailed descriptions which follow are presented interms of procedures, logic blocks, processing and other symbolicrepresentations of operations on data bits within a computer memory.These descriptions and representations are the means used by thoseskilled in the data processing arts to most effectively convey thesubstance of their work to others skilled in the art. In the presentapplication, a procedure, logic block, process, or the like, isconceived to be one or more self-consistent procedures or instructionsleading to a desired result. The procedures are those requiring physicalmanipulations of physical quantities. Usually, although not necessarily,these quantities take the form of electrical or magnetic signals capableof being stored, transferred, combined, compared, and otherwisemanipulated in an electronic device.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the followingdiscussions, it is appreciated that throughout the description ofembodiments, discussions utilizing terms such as “receiving,” “parsing,”“determining,” “executing,” “evaluating,” “selecting,” “scanning,”“caching,” “refreshing,” “generating,” “returning,” “replacing,”“comparing,” “performing,” or the like, refer to the actions andprocesses of an electronic computing device or system such as: a hostprocessor, a processor, a memory, a cloud-computing environment, ahyper-converged appliance, a software defined network (SDN) manager, asystem manager, a virtualization management server or a virtual machine(VM), among others, of a virtualization infrastructure or a computersystem of a distributed computing system, or the like, or a combinationthereof. The electronic device manipulates and transforms datarepresented as physical (electronic and/or magnetic) quantities withinthe electronic device's registers and memories into other data similarlyrepresented as physical quantities within the electronic device'smemories or registers or other such information storage, transmission,processing, or display components.

Embodiments described herein may be discussed in the general context ofprocessor-executable instructions residing on some form ofnon-transitory processor-readable medium, such as program modules,executed by one or more computers or other devices. Generally, programmodules include routines, programs, objects, components, datastructures, etc., that perform particular tasks or implement particularabstract data types. The functionality of the program modules may becombined or distributed as desired in various embodiments.

In the figures, a single block may be described as performing a functionor functions; however, in actual practice, the function or functionsperformed by that block may be performed in a single component or acrossmultiple components, and/or may be performed using hardware, usingsoftware, or using a combination of hardware and software. To clearlyillustrate this interchangeability of hardware and software, variousillustrative components, blocks, modules, circuits, and steps have beendescribed generally in terms of their functionality. Whether suchfunctionality is implemented as hardware or software depends upon theparticular application and design constraints imposed on the overallsystem. Skilled artisans may implement the described functionality invarying ways for each particular application, but such implementationdecisions should not be interpreted as causing a departure from thescope of the present disclosure. Also, the example mobile electronicdevice described herein may include components other than those shown,including well-known components.

The techniques described herein may be implemented in hardware,software, firmware, or any combination thereof, unless specificallydescribed as being implemented in a specific manner. Any featuresdescribed as modules or components may also be implemented together inan integrated logic device or separately as discrete but interoperablelogic devices. If implemented in software, the techniques may berealized at least in part by a non-transitory processor-readable storagemedium comprising instructions that, when executed, perform one or moreof the methods described herein. The non-transitory processor-readabledata storage medium may form part of a computer program product, whichmay include packaging materials.

The non-transitory processor-readable storage medium may comprise randomaccess memory (RAM) such as synchronous dynamic random access memory(SDRAM), read only memory (ROM), non-volatile random access memory(NVRAM), electrically erasable programmable read-only memory (EEPROM),FLASH memory, other known storage media, and the like. The techniquesadditionally, or alternatively, may be realized at least in part by aprocessor-readable communication medium that carries or communicatescode in the form of instructions or data structures and that can beaccessed, read, and/or executed by a computer or other processor.

The various illustrative logical blocks, modules, circuits andinstructions described in connection with the embodiments disclosedherein may be executed by one or more processors, such as one or moremotion processing units (MPUs), sensor processing units (SPUs), hostprocessor(s) or core(s) thereof, digital signal processors (DSPs),general purpose microprocessors, application specific integratedcircuits (ASICs), application specific instruction set processors(ASIPs), field programmable gate arrays (FPGAs), or other equivalentintegrated or discrete logic circuitry. The term “processor,” as usedherein may refer to any of the foregoing structures or any otherstructure suitable for implementation of the techniques describedherein. In addition, in some aspects, the functionality described hereinmay be provided within dedicated software modules or hardware modulesconfigured as described herein. Also, the techniques could be fullyimplemented in one or more circuits or logic elements. A general purposeprocessor may be a microprocessor, but in the alternative, the processormay be any conventional processor, controller, microcontroller, or statemachine. A processor may also be implemented as a combination ofcomputing devices, e.g., a combination of an SPU/MPU and amicroprocessor, a plurality of microprocessors, one or moremicroprocessors in conjunction with an SPU core, MPU core, or any othersuch configuration.

Overview of Discussion

Example embodiments described herein improve the performance of computersystems by improving the performance of a query of time series data. Amultiple stage analysis of a plurality of paths of execution forresolving the query is performed. The multiple stage analysis results ina path of execution, including the operations for resolving the querythat efficiently utilizes required resources, by implicitly determiningintent of the query. The query planner can perform the analysis of eachstage for multiple paths of execution concurrently.

For example, at each stage of the analysis, each executed path ofexecution is evaluated for the stage. If a particular path of executionis determined to be too costly (e.g., relative to other paths ofexecution), the particular path of execution may be ceased or paused,and other paths of execution can be pursued. In some embodiments, thequery planner uses available statistics and underlying metrics togenerate the query plan. The query plan provides a path of execution toa query executor for executing the query.

In some embodiments, a multiple stage analysis for a plurality of pathsof execution is performed on a query. At completion of each stage forpaths of execution that are executed, an evaluation is performed todetermine whether to continue particular paths of execution and a nextstage of the analysis is determined. The execution of a stage provides astate of each executed path of execution. The multiple stage analysisculls down the potential paths of execution, based on the evaluation,until one path of execution is selected as the query plan. The path ofexecution of the query plan includes a series of operations used forresolving the query, and is passed on to a query executor for executionand returning an answer to the query.

In some embodiments, the evaluation considers a cost of performing thestage for each path of execution. The cost can be based on one or moreof a number of factors, such as execution time, processing load, memoryusage, index reload time, etc. Costs of each stage for the multiplepaths of execution are compared, and a subset of paths of execution isselected for continued execution and evaluation based on the cost. Forpaths of the subset of paths of execution, a next stage is determinedfor execution, and the multiple stage analysis is performed iterativelyto reduce the subset of paths of execution to a single path ofexecution.

In one embodiment, a second stage for the subset of paths of executionis determined. In one embodiment, the second stage for the subset ofpaths of execution is determined by determining a presumptive costassociated with executing the second stage of the subsets of paths ofexecution. The second stage for the subset of paths of execution isdetermined based at least in part on the presumptive cost associatedwith executing the second stage of the subsets of paths of execution.The second stage for the subset of paths of execution is executed. Thesubset of paths of execution is evaluated after completion of the secondstage. In one embodiment, a path of execution of the plurality of pathsof execution is selected as the query plan based on the evaluating thesubset of paths of execution.

In various embodiments, the executing the stages of the paths ofexecution includes accessing indices for locating a data source tosatisfy the query. Time series data is collected and sorted into aplurality of indices to facilitate retrieval of the source time seriesdata (e.g., which data stream to access or which data store to access).The indices are selectively refreshed based on a determination as towhether an index is helpful in reducing the solution set. Reloadingand/or refreshing an index into memory can be a costly (e.g., timeintensive) operation. Therefore, selectively refreshing indices based onan analysis of the respective importance of an index can decrease theprocessing time, and therefore improve efficiency of obtaining thesolution set for the query.

In some embodiments, a generated query plan including a path ofexecution for resolving a query is stored for later retrieval responsiveto receiving a matching query. Saving and accessing a query plan for amatching query improves the performance of the computer system by notrequiring a real-time multiple stage analysis of the query. In someembodiments, the stored query plan is evaluated offline to confirmwhether the generated query plan should be saved or it should bereplaced with another query plan. For example, the multiple stageanalysis of a query may result in a particular query plan as the leastcostly query plan. However, due to the culling of costly paths ofexecution during the multiple stage query analysis, there may be lesscostly path of execution. Offline, in a non-time sensitive environment,the path of execution of the query plan can be compared to other pathsof execution (e.g., without culling paths during analysis). An aggregatecost can be determined for each path of execution, and the aggregatecost for each path of execution can be compared. If the stored path ofexecution is not the least costly path of execution, the query plan canbe replaced with another path of execution that is less costly.

Example System for Query Plan Generation

FIG. 1 is a block diagram illustrating an embodiment of a system 100 formanaging data including responding to a query 110 regarding time seriesdata. In one embodiment, system 100 generates a query plan for the timeseries data based on the query 110. System 100 includes a parser 104, aplanner 106, and an executor 108. System 100 can be implemented by aquery execution engine configured to parse a query at parser 104,produce a query execution plan at planner 106, fetch time series dataand run the time series data through processing operations, anddetermine an answer or response to the query at executor 108.

In the example shown in FIG. 1, a query 110 is received. In oneembodiment, the query 110 is provided by a user via a client. Timeseries data is provided by storage devices 102. The storage devices 102store and output time series data, e.g., TS1, TS2, TS3, etc. In variousembodiments, the storage devices 102 include a storage system such astime series database (TSDB). The data can include times series data,which may be discrete or continuous. For example, the data can includelive data fed to a discrete stream, e.g., for a standing query.Continuous sources can include analog output representing a value as afunction of time. With respect to processing operations, continuous datamay be time sensitive, e.g., reacting to a declared time at which a unitof stream processing is attempted, or a constant, e.g., a 5V signal.Discrete streams can be provided to the processing operations intimestamp order. It should be appreciated that the time series data maybe queried in real-time (e.g., by accessing the live data stream) oroffline processing (e.g., by accessing the stored time series data).

In some embodiments, time series data includes a numerical measurementof a system or activity that can be collected and stored as a metric(also referred to as a “stream”). For example, one type of metric is aCPU load measured over time. Other examples include, service uptime,memory usage, etc. It should be appreciated that metrics can becollected for any type of measurable performance of a system oractivity. Operations can be performed on data points in a stream. Insome instances, the operations can be performed in real time as datapoints are received. In other instances, the operations can be performedon historical data. Metrics analysis include a variety of use casesincluding online services (e.g., access to applications), softwaredevelopment, energy, Internet of Things (IoT), financial services (e.g.,payment processing), healthcare, manufacturing, retail, operationsmanagement, and the like. It should be appreciated that the precedingexamples are non-limiting, and that metrics analysis can be utilized inmany different types of use cases and applications.

In accordance with some embodiments, a data point in a stream (e.g., ina metric) includes a name, a source, a value, and a time stamp.Optionally, a data point can include one or more tags (e.g., pointtags). For example, a data point for a metric may include:

-   -   A name—the name of the metric (e.g., CPU_idle, service.uptime)    -   A source—the name of an application, host, container, instance,        or other entity generating the metric (e.g., web_server_1, app1,        app2)    -   A value—the value of the metric (e.g., 99% idle, 1000, 2000)    -   A timestamp—the timestamp of the metric (e.g., 1418436586000)    -   One or more point tags (optional)—custom metadata associated        with the metric (e.g., location=las_vegas, environment=prod)

Time series data is received at indexer 112 for generating indices 114.Time series data is collected and sorted into a plurality of indices 114to facilitate retrieval of the source time series data (e.g., which datastream to access or which data store to access). It should beappreciated that indexer 112 can generate many different types ofindices 114 for facilitating data retrieval. For example, indices 114can include one or more of a prefix index, a trigram index, a two-tierindex, and a three-tier index. A prefix index is an index that includesprefixes of searchable terms. A trigram index is an index that includesthree letter combinations of searchable terms. A two-tier index is anindex that relates two searchable dimensions (e.g., metric to host orhost to metric). A three-tier index is an index that relates threesearchable dimensions (e.g., metric to host to point tag or host tometric to point tag).

Query 110 is received for searching the time series data. A query caninclude elements that define searchable parameters of the time seriesdata. For example, the query can include elements defining terms relatedto metrics, sources, values, timestamps, and/or point tags for isolatingand returning relevant results. The parser 104 receives a query 110 andparses the query for a predicate (e.g., elements and operators). Thepredicate forms at least part of a basis for generating a query plan.For instance, consider the example query:

-   -   ts(“*graf*”, host=“*2*” and tag=app and (status=production or        role=app) and cluster=mon and cpu=cpu-total)

The example query is parsed into the predicate including the elementsand operators:

-   -   metric=“*graf*” AND    -   host=“*2*” AND    -   (status=production OR role=app) AND    -   cluster=mon AND    -   cpu=cpu-total

The planner 106 receives the parsed elements and operators of query 110and generates a query plan for retrieval of relevant time series datathat resolves the query 110. The planner 106 determines operations to beperformed on the relevant time series data to retrieve a result of thequery 110.

In operation, the system 100 receives a query. Planner 106 generates aquery plan for determining what to retrieve from time series databases102 based on the query. For example, planner 106 determines how manyscans to make on the time series database(s). The planner 106 then handsoff commands (e.g., a query plan) to executor 108 to perform anexecution phase, e.g., beginning execution of the query 110. Theexecutor 108 then outputs an answer to the query. Although shown as asingle stream, the answer to the query can include one or more streams.

FIG. 2 is a block diagram illustrating an embodiment of a planner 106for generating a query plan for responding to a query 110 regarding timeseries data. In one embodiment, planner 106 generates a query plan forthe time series data based on the parsed query 202. Planner 106 includesstage determiner 204, stage executor 206, path evaluator 208, and pathselector 210. In some embodiments, planner 106 also includes costinformation 212. In some embodiments, planner 106 also includes queryplan cache 216.

Stage determiner 204 receives the parsed query 202 (e.g., from parser104) and determines the first stage for a plurality of paths ofexecution of the query. A query including multiple elements and/oroperators has multiple possible paths of execution for resolving thequery. Stage determiner 204 determines a stage by analyzing the elementsand identifying possible paths of execution for each element. Forexample, for a metric element of “*graf*”, where * is a wildcard,multiple trigram lookups can be performed for accessing a trigramindex—“gra” and “raf”. A prefix scan of a prefix index can also beperformed. In another example, for a point tag element of “cluster=mon”,a three-tier tag to metric to host index can be accessed for resolvingthis stage of the possible paths of execution.

For the example query above, the six elements and operators are splitinto six possible paths of execution, one for each element. These pathsof execution can each have one or more possible first stages. Stagedeterminer 204 selects a next stage based at least on the elements. Insome embodiments, stage determiner 204 access cost information 212 toretrieve cost information for use in determining a next stage. Forexample, costs information 212 can include a cost for accessing aparticular index of indices 114 (e.g., processing time). It should beappreciated that the cost information can be either based on storedhistorical values or include default or projected values. For example,if an element of a query can be resolved by accessing one of multipleindices, stage determiner 204 can base the determination for which indexto access (e.g., the operations of a stage for a path of execution)based on cost information 212. For instance, if accessing a first indexis less costly (e.g., can be performed quicker) than accessing a secondindex, stage determiner 204 can determine the first stage to be a lookupof the first index.

Stage determiner 204 forwards the stage information to stage executor206 for execution of the stages for the paths of execution. In someembodiments, stage executor 206 is operable to execute the stages forthe multiple paths of execution concurrently (e.g., in parallel). Stageexecutor 206 executes the stages by accessing the pertinent index ofindices 114 for each stage. The index lookup/expansion is executed and acost (e.g., time of execution) of performing each stage is determined.In one embodiment, the cost for executing a stage is stored in costinformation 212 for later usage (e.g., by stage determiner 204 and/orpath evaluator 208).

In one embodiment, stage executor 206 is operable to control selectiverefreshing of particular indices of indices 114. For example, stageexecutor 206 is configured to make a determination as to a potentialusefulness of particular indices in reducing a solution set for thestage of a path of execution of the plurality of paths of execution.

FIG. 3A is a block diagram illustrating an example stage executor 206for executing operations of stages for multiple paths of execution 320a-n during query plan generation, in accordance with embodiments. Itshould be appreciated that stage executor 206 can perform stageconcurrent (e.g., parallel) execution for any number of paths ofexecution, of which the illustrated embodiment is an example. Stageinformation 302 a-n (e.g., an output of stage determiner 204) isreceived for each path of execution 320 a-n, respectively. It should beappreciated that an embodiment of the operations of paths of execution320 a-n is illustrated in path of execution 320 of FIG. 3B.

FIG. 3B is a block diagram illustrating stage execution for executingoperations for stages of one path of execution 320 during query plangeneration, in accordance with embodiments. It should be appreciatedthat any combination of the operations of path of execution 320 may beutilized in paths of execution 320 a-n of FIG. 3A.

Stage information 302 (e.g., an output of stage determiner 204) isreceived at stage operation identifier 304. Stage operation identifier304 is configured to determine the operations of a particular stage ofthe plurality of paths of operation. For instance, stage operationidentifier 304 is configured to determine which particular index ofindices 114 is accessed by a particular stage during stage execution forpath of execution 320.

In some embodiments, path of execution 320 includes element converter306 that is configured to convert an element into a format that issearchable via an index. Identifiers may be used in the index and/or theelement, requiring conversion from an identifier to an element or anelement to an identifier. For example, where the element is a metric, ametric identifier may be used in the index (e.g., a metric to hostindex). Therefore, the metric is converted to a metric identifier forpurposes of scanning the index.

Index retriever 308 receives the searchable element (or elementidentifier) and accesses the relevant index identified by stageoperation identifier 304. In some embodiments, an index of indices 114is selectively refreshed by index refresher 310 based on a potentialusefulness of the index in reducing a solution set for the stage of apath of execution of the plurality of paths of execution. Time seriesdata may be continually received (e.g., from storage devices 102), whichmay necessitate a refresh and/or reload of the indices to account forthe new time series data. However, if an index is not accessed during astage of a path of execution, there no need to refresh the index.Moreover, even if an index is accessed, if the index does not contributeto a reduction of the solution set, there is no need to refresh theindex. In one embodiment, historical information may be used indetermining whether an index has contributed to a reduction of thesolution set for operations of a stage (e.g., for a matching or similarstage). In such embodiments, index refresher 310 may include or haveaccess to information regarding whether an index will contribute to areduction of the solution set.

Element expander 312 performs expansion of the element of stage 302 intothe accessed index of indices 114, for determining a reduced solutionset of the query. In one embodiment, an index scan is performed usingthe element (or element identifier) against the index, and a stageresult is generated. In some embodiments, a cost (e.g., processing time)of performing the element expansion is determined. Executed stageresults and cost 314 are output for path of execution 320. It should beappreciated that executed stage results can include a reduced solutionset, a null set (no solutions), a non-reduced solution set, etc.

With reference to FIG. 3A, executed stage results and costs 314 a-n aregenerated for each path of execution 320 a-n, respectively. Executedstage results and costs 314 a-n are provided to path evaluator 208. Inone embodiment, the costs are also stored in cost information 212 ashistorical cost information for operations of a particular stage. Costinformation 212 can be retrieved by stage determiner 204, path evaluator208, and or path selector 210 for use in evaluating path stages.

Path evaluator 208 evaluates the plurality of paths of execution aftercompletion of each stage. In some embodiments, the evaluation is basedon the cost of performing the respective stages of each path ofexecution. For example, as time series data is often time-sensitive, thecost used in evaluating each path of execution is the processing timefor performing the stage for each path of execution. For instance, theprocessing time may include the element conversion, the index access, anindex refresh (if needed), and the element expansion. The cost may bethe total processing to for each stage.

The evaluation for each path of execution is provided to path selector210. Based on the evaluating, a subset of paths of execution is selectedfor continued execution and evaluation. In one embodiment, selecting thesubset of paths of execution for continued execution and evaluationincludes selecting a path of execution having a lowest cost of executionof the first stage for inclusion within the subset of paths ofexecution. Additional paths of execution having a cost that satisfies athreshold for inclusion within the subset of paths of execution areselected.

In one embodiment, the threshold includes a multiple of the lowest costof execution such that paths of execution for which the cost is withinthe multiple of the lowest cost of execution are selected for inclusionwithin the subset of paths of execution. For example, if the cost usedin evaluating the paths of execution is processing time, and the path ofexecution with the lowest processing time has a processing time of 3milliseconds, all paths of execution with 3× of processing time (e.g., 9milliseconds) are selected for continued execution and evaluation. Inanother embodiment, the threshold includes a number of paths that have acost closest to the lowest cost of execution such that paths ofexecution the number of paths closest to the lowest cost of executionare selected for inclusion within the subset of paths of execution. Forexample, the three lowest cost paths of execution can be selected forfurther execution and evaluation. It should be appreciated thatdifferent thresholds or combinations of thresholds can be used, as willbe understood by those of skill in the art, and that the describedexamples or intended to be non-limiting.

Path selector 210 is configured to select a subset of paths of executionfor continued execution and evaluation, and provides the selected subsetof paths of execution to stage determiner 204. The execution of thesubset of paths of execution is processed by stage determiner 204, stageexecutor 206, path evaluator 208, and path selector 210, as described,iteratively until a single path of execution remains. The single path ofexecution as output by path selector 210 is output as query plan 214.

With reference to FIG. 1, the executor 108 handles an “execution phase”in which operations are performed on time series data to generate ananswer to the query. In various embodiments, the executor 108 executes aquery plan 214 from planner 106 and performs operations on the timeseries data based on the query plan, where the query plan includes apath of execution for resolving query 110. For example, one or moreexecutors can perform the operation on the time series dataconcurrently. In various embodiments, the executor 108 responds to aquery about the time series data and outputs an answer 116 to the query.Although shown as separate components in FIG. 1, the planner 106 and theexecutor 108 can be implemented as a single component. The techniquesdescribed herein can be performed by the planner 106 and/or the executor108.

With reference to FIG. 2, query plan 214 is also cached at query plancache 216 for subsequent use. Query plan 214 is cached in a way suchthat the associated query that resulted in the generation of query plan214 is searchable. In one embodiment, prior to executing a query, thequery is searched to determine if the query matches a query associatedwith a previously cached query plane. Responsive to determining that areceived query matches the query associated with the query plan, thequery plan is retrieved. The query plan can then be used for executingthe query without needing to generate a query plan, thereby improvingthe performance of the computer system.

In one embodiment, subsequent to generating the query plan in themultiple stage manner as described above, the path of execution of queryplan 214 is evaluated against other possible paths of execution withoutiteratively reducing possible solution sets. For example, while themultiple stage execution of the query as described above may beperformed in real time under time-sensitive demands (e.g., a result tothe query is requested), the path of execution of the query plan 214 canbe evaluated offline in a non-time sensitive environment by evaluatingagainst other possible fully executed paths of execution.

For example, in one embodiment, a cost for each of the plurality ofpaths of execution for the query is determined. This can be an aggregatecost for all stages of each path of execution. It should be appreciatedthat the process described above may cease evaluation of a particularpath of execution (e.g., the path of execution did not satisfy a costthreshold) that ultimately could be a lowest cost path of execution.Therefore, subsequent evaluation of the path of execution of the queryplan may result in a lower cost path of execution. In one embodiment,determining whether to replace the query plan as cached with anotherquery plan including a path of execution of the plurality of paths ofexecution includes comparing a cost of the path of execution of thequery plan to costs for the plurality of paths of execution for thequery. If a cost of a path of execution of the plurality of paths ofexecution is less than the cost of the path of execution of the queryplan as cached, the path of execution of the query plan as cached isreplaced with the path of execution of the plurality of paths ofexecution.

Replacing query plan 214 with another query plan having a lower cost ofexecution at query plan cache 216 allows for continued improvement ofthe cost (e.g., processing time) of an executed query. For instance, ifa query is received that matches a query that resulted in a particularquery plan, the query plan can be selected for execution withoutregenerating the query plan. Moreover, if the query plan generated wasevaluated subsequently against all other possible paths of execution,resulting in the query plan being replaced by a lower cost (e.g., betterperforming) query plan, receiving the query will result in the executionof the replacement query plan, thereby improving the performance of thequery processing by using a previously generated query plan that wasevaluated against all other possible paths of operation, providing thebest performing query plan.

FIG. 4 is a block diagram of an example computer system 400 upon whichembodiments of the present invention can be implemented. FIG. 4illustrates one example of a type of computer system 400 (e.g., acomputer system) that can be used in accordance with or to implementvarious embodiments which are discussed herein.

It is appreciated that computer system 400 of FIG. 4 is only an exampleand that embodiments as described herein can operate on or within anumber of different computer systems including, but not limited to,general purpose networked computer systems, embedded computer systems,mobile electronic devices, smart phones, server devices, client devices,various intermediate devices/nodes, standalone computer systems, mediacenters, handheld computer systems, multi-media devices, and the like.In some embodiments, computer system 400 of FIG. 4 is well adapted tohaving peripheral tangible computer-readable storage media 402 such as,for example, an electronic flash memory data storage device, a floppydisc, a compact disc, digital versatile disc, other disc based storage,universal serial bus “thumb” drive, removable memory card, and the likecoupled thereto. The tangible computer-readable storage media isnon-transitory in nature.

Computer system 400 of FIG. 4 includes an address/data bus 404 forcommunicating information, and a processor 406A coupled with bus 404 forprocessing information and instructions. As depicted in FIG. 4, computersystem 400 is also well suited to a multi-processor environment in whicha plurality of processors 406A, 406B, and 406C are present. Conversely,computer system 400 is also well suited to having a single processorsuch as, for example, processor 406A. Processors 406A, 406B, and 406Cmay be any of various types of microprocessors. Computer system 400 alsoincludes data storage features such as a computer usable volatile memory408, e.g., random access memory (RAM), coupled with bus 404 for storinginformation and instructions for processors 406A, 406B, and 406C.Computer system 400 also includes computer usable non-volatile memory410, e.g., read only memory (ROM), coupled with bus 404 for storingstatic information and instructions for processors 406A, 406B, and 406C.Also present in computer system 400 is a data storage unit 412 (e.g., amagnetic or optical disc and disc drive) coupled with bus 404 forstoring information and instructions. Computer system 400 also includesan alphanumeric input device 414 including alphanumeric and functionkeys coupled with bus 404 for communicating information and commandselections to processor 406A or processors 406A, 406B, and 406C.Computer system 400 also includes an cursor control device 416 coupledwith bus 404 for communicating user input information and commandselections to processor 406A or processors 406A, 406B, and 406C. In oneembodiment, computer system 400 also includes a display device 418coupled with bus 404 for displaying information.

Referring still to FIG. 4, display device 418 of FIG. 4 may be a liquidcrystal device (LCD), light emitting diode display (LED) device, cathoderay tube (CRT), plasma display device, a touch screen device, or otherdisplay device suitable for creating graphic images and alphanumericcharacters recognizable to a user. Cursor control device 416 allows thecomputer user to dynamically signal the movement of a visible symbol(cursor) on a display screen of display device 418 and indicate userselections of selectable items displayed on display device 418. Manyimplementations of cursor control device 416 are known in the artincluding a trackball, mouse, touch pad, touch screen, joystick orspecial keys on alphanumeric input device 414 capable of signalingmovement of a given direction or manner of displacement. Alternatively,it will be appreciated that a cursor can be directed and/or activatedvia input from alphanumeric input device 414 using special keys and keysequence commands. Computer system 400 is also well suited to having acursor directed by other means such as, for example, voice commands. Invarious embodiments, alphanumeric input device 414, cursor controldevice 416, and display device 418, or any combination thereof (e.g.,user interface selection devices), may collectively operate to provide agraphical user interface (GUI) 430 under the direction of a processor(e.g., processor 406A or processors 406A, 406B, and 406C). GUI 430allows user to interact with computer system 400 through graphicalrepresentations presented on display device 418 by interacting withalphanumeric input device 414 and/or cursor control device 416.

Computer system 400 also includes an I/O device 420 for couplingcomputer system 400 with external entities. For example, in oneembodiment, I/O device 420 is a modem for enabling wired or wirelesscommunications between computer system 400 and an external network suchas, but not limited to, the Internet. In one embodiment, I/O device 420includes a transmitter. Computer system 400 may communicate with anetwork by transmitting data via I/O device 420.

Referring still to FIG. 4, various other components are depicted forcomputer system 400. Specifically, when present, an operating system422, applications 424, modules 426, and data 428 are shown as typicallyresiding in one or some combination of computer usable volatile memory408 (e.g., RAM), computer usable non-volatile memory 410 (e.g., ROM),and data storage unit 412. In some embodiments, all or portions ofvarious embodiments described herein are stored, for example, as anapplication 424 and/or module 426 in memory locations within RAM 408,computer-readable storage media within data storage unit 412, peripheralcomputer-readable storage media 402, and/or other tangiblecomputer-readable storage media.

Example Methods of Operation

The following discussion sets forth in detail the operation of someexample methods of operation of embodiments. With reference to FIGS. 5through 10, various flow diagrams illustrate example procedures used byvarious embodiments. The flow diagrams of FIGS. 5 through 10 includesome procedures that, in various embodiments, are carried out by aprocessor under the control of computer-readable and computer-executableinstructions. In this fashion, procedures described herein and inconjunction with the flow diagrams are, or may be, implemented using acomputer, in various embodiments. The computer-readable andcomputer-executable instructions can reside in any tangible computerreadable storage media. Some non-limiting examples of tangible computerreadable storage media include random access memory, read only memory,magnetic disks, solid state drives/“disks,” and optical disks, any orall of which may be employed with computer environments (e.g., computersystem 400). The computer-readable and computer-executable instructions,which reside on tangible computer readable storage media, are used tocontrol or operate in conjunction with, for example, one or somecombination of processors of the computer environments and/orvirtualized environment. It is appreciated that the processor(s) may bephysical or virtual or some combination (it should also be appreciatedthat a virtual processor is implemented on physical hardware). Althoughspecific procedures are disclosed in the flow diagrams, such proceduresare examples. That is, embodiments are well suited to performing variousother procedures or variations of the procedures recited in the flowdiagrams. Likewise, in some embodiments, the procedures in the flowdiagrams of FIGS. 5 through 10 may be performed in an order differentthan presented and/or not all of the procedures described in one or moreof these flow diagrams may be performed. It is further appreciated thatprocedures described in the flow diagrams of FIGS. 5 through 10 may beimplemented in hardware, or a combination of hardware with firmwareand/or software provided by computer system 400.

FIG. 5 depicts a flow diagram 500 for generating a query plan for timeseries data, according to various embodiments. At procedure 510 of FIG.5, a query for time series data is received (e.g., at system 100 of FIG.1), the query including elements. In one embodiment, the elementsinclude at least one of a metric, a host, and a tag. At procedure 520,the query is parsed to identify the elements and operators between theelements (e.g., at parser 104 of FIG. 1).

At procedure 530, stages for a plurality of paths of execution aredetermined based at least in part on the elements and the operators(e.g., at planner 106 and/or stage determiner 204). In some embodiments,the elements and operators identify which index is accessed for a stage,thereby identifying the stages. Procedure 530 can also utilizepresumptive cost information in determining stages for paths ofexecution. For each path of execution, there may be multiple options ofstages to perform. In one embodiment, procedure 530 is performedaccording to flow diagram 600 of FIG. 6A. At procedure 602 of flowdiagram 600, a presumptive cost of executing the stage is determined foreach path of execution. In one embodiment, the presumptive cost is basedon historical values. In another embodiment, the presumptive cost isbased on a default or projected value. At procedure 604, the stage isdetermined based at least in part on the presumptive cost. For example,the presumptive cost for each possible stage for a path of execution canbe compared to each other and/or a threshold. A stage having the lowestcost can be selected as the next stage. If all possible stages do notsatisfy a threshold (e.g., are too costly), the path of execution may bepaused or ceased.

At procedure 540, a stage for the plurality of paths of execution isexecuted (e.g., at stage executor 206). In one embodiment, the stagesfor the plurality of paths of execution are executed concurrently (e.g.,in parallel). In one embodiment, procedure 540 is performed according toflow diagram 610 of FIG. 6B. At procedure 612 of flow diagram 610, anindex to access is determined based on an element of the path ofexecution. At procedure 614, the index is scanned to identify a culledsolution set based on the element for resolving the query. In variousembodiments, the index is one of a prefix index, a trigram index, atwo-tier index, and a three-tier index.

In another embodiment, procedure 540 is performed according to flowdiagram 620 of FIG. 6C. At procedure 622 of flow diagram 620, for eachpath of execution, a cost associated with executing the first stage ofthe path of execution is determined. At procedure 624, the costassociated with executing the first stage of the path of execution iscached. It should be appreciated that procedure 540 may include theprocedures of both flow diagrams 610 and 620.

At procedure 550, the plurality of paths of execution is evaluated aftercompletion of the stage (e.g., at path evaluator 208). In oneembodiment, procedure 550 is performed according to flow diagram 630 ofFIG. 6D. At procedure 632 of flow diagram 630, for each path ofexecution, a cost associated with executing the at least a first stageof the path of execution is determined. At procedure 634, the path ofexecution is evaluated based at least in part on the cost associatedwith executing the at least a first stage of the path of execution.

At procedure 560, based on the evaluating, a subset of paths ofexecution is selected for continued execution and evaluation (e.g., atpath selector 210). In one embodiment, procedure 560 is performedaccording to flow diagram 640 of FIG. 6E. At procedure 642 of flowdiagram 640, a path of execution having a lowest cost of execution ofthe first stage for inclusion within the subset of paths of execution isselected. At procedure 644, additional paths of execution having a costthat satisfies a threshold for inclusion within the subset of paths ofexecution are selected. In one embodiment, the threshold includes amultiple of the lowest cost of execution such that paths of executionfor which the cost is within the multiple of the lowest cost ofexecution are selected for inclusion within the subset of paths ofexecution. In another embodiment, the threshold includes a number ofpaths that have a cost closest to the lowest cost of execution such thatpaths of execution the number of paths closest to the lowest cost ofexecution are selected for inclusion within the subset of paths ofexecution.

At procedure 570, it is determined whether multiple possible paths ofexecution remain. If multiple paths of execution remain for executionand analysis, flow diagram 500 returns to procedure 530 for continuedexecution and evaluation of the subset of multiple paths of execution.If a single path of execution remains or the subset of paths is reducedto a single path based on the threshold analysis, as shown at procedure580, the remaining path of execution is selected as the query plan. Thepath of operation of the query plan is the selected path of executionfor locating a data source to satisfy the query. In one embodiment, asshown at procedure 590, the query plan is cached (e.g., at query plancache 216).

In accordance with various embodiments, indices are accessed forperforming the multiple stage analysis of the plurality of paths ofoperation for locating a data source to satisfy the query. Time seriesdata is collected and sorted into a plurality of indices to facilitateretrieval of the source time series data (e.g., which data stream toaccess or which data store to access). FIG. 7 depicts a flow diagram 700for generating indices for time series data, according to variousembodiments. At procedure 710 of flow diagram 700, time series data(e.g., TS1, TS2, and TS3 from storage devices 102) is received. Atprocedure 720, indices corresponding to the time series data aregenerated (e.g., by indexer 112). At procedure 730, the indices arestored in an index cache (e.g., indices 114 of FIG. 1).

The indices are selectively refreshed based on a determination as towhether an index is helpful in reducing the solution set. Reloadingand/or refreshing an index into memory can be a costly (e.g., timeintensive) operation. Therefore, selectively refreshing indices based onan analysis of the respective importance of an index can decrease theprocessing time, and therefore improve efficiency of obtaining thesolution set for the query. FIG. 8 depicts a flow diagram 800 fordynamic refresh of an index during query path generation for time seriesdata, according to various embodiments.

At procedure 810 of flow diagram 800, during generation of a query planbased on the query, operations in a stage for a plurality of paths ofexecution are determined based at least in part on the elements of thequery, wherein execution of the stage includes accessing an index of aplurality of indices. In various embodiments, procedure 810 is performedat procedure 530 and/or procedure 612. In one embodiment, the query planis generated in real-time.

At procedure 820, it is determined whether to refresh indices of aplurality of indices based on a potential usefulness of the indices inreducing a solution set for the stage of a path of execution of theplurality of paths of execution. In one embodiment, as shown atprocedure 822, for each index of the plurality of indices, it isdetermined whether an index of the plurality of indices is accessedduring execution of the stage for at least one path of execution of theplurality of paths of execution. If the index is not accessed duringexecution of the stage for at least one path of execution of theplurality of paths of execution, it is determined that the index is notuseful for reducing the solution set for the stage of a path ofexecution of the plurality of paths of execution, and flow diagram 800proceeds to procedure 834.

If the index is accessed during execution of the stage for at least onepath of execution of the plurality of paths of execution, as shown atprocedure 824, it is determined whether the index is useful for reducingthe solution set the solution set for the stage of a path of executionof the plurality of paths of execution. If the index is useful forreducing the solution set the solution set for the stage of a path ofexecution of the plurality of paths of execution, flow diagram 800proceeds to procedure 832. Alternatively, if the index is not useful forreducing the solution set the solution set for the stage of a path ofexecution of the plurality of paths of execution, flow diagram 800proceeds to procedure 834.

At procedure 830, the indices are selectively refreshed based on thedetermination. If the index is not useful for reducing the solution setfor the stage of a path of execution of the plurality of paths ofexecution, as shown at procedure 834, the index is not refreshed. If theindex is useful for reducing the solution set for the stage of a path ofexecution of the plurality of paths of execution, as shown at procedure832, the index is refreshed. In some embodiments, if it is determined torefresh indices of the plurality of indices, the indices to be refreshedare retrieved from the index cache. The stage for the plurality of pathsof execution is then executed (e.g., procedure 540 is then executed).

In some embodiments, a generated query plan including a path ofexecution for resolving a query is stored for later retrieval responsiveto receiving a matching query. Saving and accessing a query plan for amatching query improves the performance of the computer system by notrequiring a real-time multiple stage analysis of the query.

In accordance with various embodiments, in a method for caching agenerated query plan for time series data, a query plan for time seriesdata is generated based on a query including an expression, the queryplan including a path of execution for resolving the query (e.g., atflow diagram 500 of FIG. 5). The path of execution of the query plan toresolve the query is executed. A result of the path of execution isreturned as a response to the query. The query plan is cached forretrieval and execution responsive to receiving another query thatmatches the query, such that the query plan can be used to resolve theanother query (e.g., at procedure 590 of flow diagram 500).

FIG. 9 depicts a flow diagram 900 for using a cached query plan for timeseries data, according to various embodiments. At procedure 910, a newquery is received. At procedure 920, it is determined whether the newquery matches the query for the cached query plan. If the new query doesnot match the query associated with the query plan, a multiple stageanalysis is performed on the new query (e.g., flow diagram 900 proceedsto procedure 520 of flow diagram 500). Responsive to determining that areceived query matches the query associated with the query plan, asshown at procedure 930, the query plan is retrieved. In one embodiment,as shown at procedure 940, the path of execution of the query plan isexecuted to resolve the received query. At procedure 950, a result ofthe path of execution is returned as a response to the received query.

In some embodiments, the stored query plan is evaluated offline toconfirm whether the generated query plan should be saved or it should bereplaced with another query plan. For example, the multiple stageanalysis of a query may result in a particular query plan as the leastcostly query plan. However, due to the culling of costly paths ofexecution during the multiple stage query analysis, there may be lesscostly path of execution. Offline, in a non-time sensitive environment,the path of execution of the query plan can be compared to other pathsof execution (e.g., without culling paths during analysis). FIG. 10depicts a flow diagram 1000 for evaluating a cached query plan,according to various embodiments.

In one embodiment, the query plan is cached (e.g., at procedure 590 offlow diagram 500). At procedure 1010 of flow diagram 1000, the queryplan including the path of execution is evaluated against a plurality ofpaths of execution for the query. In one embodiment, as shown atprocedure 1012, the query plan including the path of execution isevaluated against a plurality of paths of execution for the queryincludes executing the plurality of paths of execution for the query. Atprocedure 1014, a cost for each of the plurality of paths of executionfor the query is determined. In one embodiment, evaluating the queryplan including the path of execution against a plurality of paths ofexecution of the query plan is performed off-line in a non-timesensitive environment.

At procedure 1020, based on the evaluating, it is determined whether toreplace the query plan as cached with another query plan including apath of execution of the plurality of paths of execution. In oneembodiment, as shown at procedure 1022, a cost of the path of executionof the query plan is compared to costs for the plurality of paths ofexecution for the query. At procedure 1024, it is determined whether acost of a path of execution of the plurality of paths of execution lessthan a cost of the path of execution of the query plans. For example, anaggregate cost can be determined for each path of execution, and theaggregate cost for each path of execution can be compared. If the storedpath of execution is not the least costly path of execution, the queryplan can be replaced with another path of execution that is less costly.If a cost of a path of execution of the plurality of paths of executionis less than the cost of the path of execution of the query plan ascached, as shown at procedure 1026, the path of execution of the queryplan as cached is replaced with the path of execution of the pluralityof paths of execution. Alternatively, if a cost of a path of executionof the plurality of paths of execution is not less than the cost of thepath of execution of the query plan as cached, as shown at procedure1028, the path of execution of the query plan as cached is not replaced.

It is noted that any of the procedures, stated above, regarding the flowdiagrams of FIGS. 5-10 may be implemented in hardware, or a combinationof hardware with firmware and/or software. For example, any of theprocedures are implemented by a processor(s) of a cloud environmentand/or a computing environment.

One or more embodiments of the present invention may be implemented asone or more computer programs or as one or more computer program modulesembodied in one or more computer readable media. The term computerreadable medium refers to any data storage device that can store datawhich can thereafter be input to a computer system—computer readablemedia may be based on any existing or subsequently developed technologyfor embodying computer programs in a manner that enables them to be readby a computer. Examples of a computer readable medium include a harddrive, network attached storage (NAS), read-only memory, random-accessmemory (e.g., a flash memory device), a CD (Compact Discs)—CD-ROM, aCD-R, or a CD-RW, a DVD (Digital Versatile Disc), a magnetic tape, andother optical and non-optical data storage devices. The computerreadable medium can also be distributed over a network coupled computersystem so that the computer readable code is stored and executed in adistributed fashion.

Although one or more embodiments of the present invention have beendescribed in some detail for clarity of understanding, it will beapparent that certain changes and modifications may be made within thescope of the claims. Accordingly, the described embodiments are to beconsidered as illustrative and not restrictive, and the scope of theclaims is not to be limited to details given herein, but may be modifiedwithin the scope and equivalents of the claims. In the claims, elementsand/or steps do not imply any particular order of operation, unlessexplicitly stated in the claims.

Many variations, modifications, additions, and improvements arepossible, regardless the degree of virtualization. Plural instances maybe provided for components, operations or structures described herein asa single instance. Finally, boundaries between various components,operations and data stores are somewhat arbitrary, and particularoperations are illustrated in the context of specific illustrativeconfigurations. Other allocations of functionality are envisioned andmay fall within the scope of the invention(s). In general, structuresand functionality presented as separate components in exemplaryconfigurations may be implemented as a combined structure or component.Similarly, structures and functionality presented as a single componentmay be implemented as separate components. These and other variations,modifications, additions, and improvements may fall within the scope ofthe appended claims(s).

What is claimed is:
 1. A method for caching a generated query plan fortime series data, the method comprising: generating a query plan fortime series data based on a query comprising elements and operatorsbetween the elements, the query plan comprising a path of execution forresolving the query, the generating the query plan comprising: parsingthe query to identify the elements and the operators between theelements; determining stages for a plurality of paths of execution basedat least in part on the elements and the operators; performing amultiple stage analysis of a plurality of paths of execution forresolving the query, wherein the plurality of paths of execution isevaluated after completion of each stage and a subset of paths ofexecution is selected for continued execution and evaluation after thecompletion of a stage of the multiple stage analysis; and selecting thepath of execution from the plurality of paths of execution based atleast in part on the multiple stage analysis; executing the path ofexecution of the query plan to resolve the query; returning a result ofthe path of execution as a response to the query; caching the query planfor retrieval and execution responsive to receiving another query thatmatches the query, such that the query plan can be used to resolve theanother query; evaluating the query plan comprising the path ofexecution against a plurality of paths of execution for the query,wherein the evaluating is performed without culling any path ofexecution from the plurality of paths of execution; and determining,based on the evaluating, whether to replace the query plan as cachedwith another query plan comprising a path of execution of the pluralityof paths of execution.
 2. The method of claim 1, further comprising:responsive to determining that a received query matches the queryassociated with the query plan, retrieving the query plan; and executingthe path of execution of the query plan to resolve the received query;and returning a result of the path of execution as a response to thereceived query.
 3. The method of claim 1, further comprising: replacing,based on the determining, the query plan as cached with a query plancomprising a path of execution of the plurality of paths of execution.4. The method of claim 1, wherein the evaluating the query plancomprising the path of execution against a plurality of paths ofexecution of the query plan is performed off-line in a non-timesensitive environment.
 5. The method of claim 1, wherein the evaluatingthe query plan comprising the path of execution against a plurality ofpaths of execution for the query comprises: executing the plurality ofpaths of execution for the query; and determining a cost for each of theplurality of paths of execution for the query.
 6. The method of claim 5,wherein the determining, based on the evaluating, whether to replace thequery plan as cached with another query plan comprising a path ofexecution of the plurality of paths of execution comprises: comparing acost of the path of execution of the query plan to costs for theplurality of paths of execution for the query; and provided a cost of apath of execution of the plurality of paths of execution is less thanthe cost of the path of execution of the query plan as cached, replacingthe path of execution of the query plan as cached with the path ofexecution of the plurality of paths of execution.
 7. The method of claim1, wherein the generating a query plan for time series data based on aquery is performed in real-time.
 8. The method of claim 1, wherein theperforming the multiple stage analysis of a plurality of paths ofexecution for resolving the query comprises: evaluating executed pathsof execution at a completion of an executed stage, wherein theevaluating is based at least in part on a cost associated with anexecuted stage for each executed path of execution; and selecting, basedon the evaluating, executed paths for continued execution andevaluation.
 9. A non-transitory computer readable storage medium havingcomputer readable program code stored thereon for causing a computersystem to perform a method for caching a generated query plan for timeseries data, the method comprising: generating a query plan for timeseries data based on a query comprising elements and operators betweenthe elements, the query plan comprising a path of execution forresolving the query, the generating the query plan comprising: parsingthe query to identify the elements and the operators between theelements; determining stages for a plurality of paths of execution basedat least in part on the elements and the operators; performing amultiple stage analysis of a plurality of paths of execution forresolving the query, wherein the plurality of paths of execution isevaluated after completion of each stage and a subset of paths ofexecution is selected for continued execution and evaluation after thecompletion of a stage of the multiple stage analysis; and selecting thepath of execution from the plurality of paths of execution based atleast in part on the multiple stage analysis; caching the query plan forretrieval and execution responsive to receiving another query thatmatches the query, such that the query plan can be used to resolve theanother query; evaluating the query plan comprising the path ofexecution against a plurality of paths of execution for the query,wherein the evaluating is performed without culling any path ofexecution from the plurality of paths of execution; and determining,based on the evaluating, whether to replace the query plan as cachedwith another query plan comprising a path of execution of the pluralityof paths of execution.
 10. The non-transitory computer readable storagemedium of claim 9, the method further comprising: executing the path ofexecution of the query plan to resolve the query; and returning a resultof the path of execution as a response to the query.
 11. Thenon-transitory computer readable storage medium of claim 9, the methodfurther comprising: responsive to determining that a received querymatches the query associated with the query plan, retrieving the queryplan; and executing the path of execution of the query plan to resolvethe received query; and returning a result of the path of execution as aresponse to the received query.
 12. The non-transitory computer readablestorage medium of claim 9, the method further comprising: replacing,based on the determining, the query plan as cached with a query plancomprising a path of execution of the plurality of paths of execution.13. The non-transitory computer readable storage medium of claim 9,wherein the evaluating the query plan comprising the path of executionagainst a plurality of paths of execution of the query plan is performedoff-line in a non-time sensitive environment.
 14. The non-transitorycomputer readable storage medium of claim 9, wherein the evaluating thequery plan comprising the path of execution against a plurality of pathsof execution for the query comprises: executing the plurality of pathsof execution for the query; and determining a cost for each of theplurality of paths of execution for the query.
 15. The non-transitorycomputer readable storage medium of claim 14, wherein the determining,based on the evaluating, whether to replace the query plan as cachedwith another query plan comprising a path of execution of the pluralityof paths of execution comprises: comparing a cost of the path ofexecution of the query plan to costs for the plurality of paths ofexecution for the query; and provided a cost of a path of execution ofthe plurality of paths of execution is less than the cost of the path ofexecution of the query plan as cached, replacing the path of executionof the query plan as cached with the path of execution of the pluralityof paths of execution.
 16. The non-transitory computer readable storagemedium of claim 9, wherein the performing the multiple stage analysis ofa plurality of paths of execution for resolving the query comprises:evaluating executed paths of execution at a completion of an executedstage, wherein the evaluating is based at least in part on a costassociated with an executed stage for each executed path of execution;and selecting, based on the evaluating, executed paths for continuedexecution and evaluation.
 17. A system for caching a generated queryplan for time series data, the system comprising: a data storage unit;and a processor communicatively coupled with the data storage unit, theprocessor configured to: generate, in real-time, a query plan for timeseries data based on a query comprising elements and operators betweenthe elements, the query plan comprising a path of execution forresolving the query, wherein the query plan is generated by parsing thequery to identify the elements and the operators between the elements,determining stages for a plurality of paths of execution based at leastin part on the elements and the operators, performing a multiple stageanalysis of a plurality of paths of execution for resolving the query,wherein the plurality of paths of execution is evaluated aftercompletion of each stage and a subset of paths of execution is selectedfor continued execution and evaluation after the completion of a stageof the multiple stage analysis, and selecting the path of execution fromthe plurality of paths of execution based at least in part on themultiple stage analysis; cache the query plan for retrieval andexecution responsive to receiving another query that matches the query,such that the query plan can be used to resolve the another query;perform, off-line in a non-time sensitive environment, an evaluation ofthe cached query plan comprising the path of execution against aplurality of paths of execution for the query, wherein the evaluation isperformed without culling any path of execution from the plurality ofpaths of execution; and selectively replace the cached query plan withanother query plan comprising a path of execution of the plurality ofpaths of execution based on the evaluation; retrieve the cached queryplan in response to determining that a second query matches the queryassociated with the cached query plan; execute the path of execution ofthe cached query plan to resolve the second query; and return a resultof the path of execution of the cached query plan as a response to thesecond query.